2025-07-13 01:31:46,497 [ 308401 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-07-13 01:31:46,497 [ 308401 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2025-07-13 01:31:46,497 [ 308401 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2025-07-13 01:31:46,497 [ 308401 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_35h8wy --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel2_0.jsonl --report-log-exclude-logs-on-passed-tests test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary test_odbc_interaction/test.py::test_sqlite_simple_select_function_works test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works test_odbc_interaction/test.py::test_sqlite_table_function test_parallel_replicas_failover/test.py::test_skip_replicas_without_table test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1]' test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards test_part_uuid/test.py::test_part_uuid test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_range_hashed_dictionary_types/test.py::test_range_hashed_dict test_read_only_table/test.py::test_restart_zookeeper test_recompression_ttl/test.py::test_recompression_multiple_ttls test_recompression_ttl/test.py::test_recompression_replicated test_recompression_ttl/test.py::test_recompression_simple test_refreshable_mv/test.py::test_adding_replica test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db test_refreshable_mv/test.py::test_refreshable_mv_in_system_db test_refreshable_mv/test.py::test_replicated_db_startup_race test_remote_prewhere/test.py::test_remote test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster 'test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12]' test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_table_attach/test.py::test_startup_with_small_bg_pool test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned test_replicating_constants/test.py::test_different_versions test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop test_rocksdb_read_only/test.py::test_read_only test_role/test.py::test_admin_option test_role/test.py::test_changing_default_roles_affects_new_sessions_only test_role/test.py::test_combine_privileges test_role/test.py::test_create_role test_role/test.py::test_function_current_roles test_role/test.py::test_grant_role_to_role test_role/test.py::test_introspection test_role/test.py::test_revoke_requires_admin_option 'test_role/test.py::test_role_expiration[False]' 'test_role/test.py::test_role_expiration[True]' test_role/test.py::test_roles_cache test_role/test.py::test_set_role test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_select_access_rights/test_main.py::test_alias test_select_access_rights/test_main.py::test_alias_columns test_select_access_rights/test_main.py::test_materialized_columns test_select_access_rights/test_main.py::test_select_all_columns test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant test_select_access_rights/test_main.py::test_select_count test_select_access_rights/test_main.py::test_select_join test_select_access_rights/test_main.py::test_select_prewhere test_select_access_rights/test_main.py::test_select_single_column test_select_access_rights/test_main.py::test_select_single_column_with_table_grant test_select_access_rights/test_main.py::test_select_union test_select_access_rights/test_main.py::test_select_where test_select_access_rights/test_main.py::test_select_with_row_policy test_shutdown_static_destructor_failure/test.py::test_shutdown test_ssh/test.py::test_create_table test_ssh/test.py::test_no_inserts_from_infile test_ssh/test.py::test_no_queries_from_file test_ssh/test.py::test_no_selects_into_outfile -vvv " altinityinfra/integration-tests-runner:ad96270260ff '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_select_access_rights/test_main.py::test_alias test_recompression_ttl/test.py::test_recompression_multiple_ttls test_partition/test.py::test_attach_check_all_parts test_rename_column/test.py::test_rename_distributed test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0] test_ssh/test.py::test_create_table test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary test_refreshable_mv/test.py::test_adding_replica test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_role/test.py::test_admin_option [gw8] [ 1%] PASSED test_ssh/test.py::test_create_table test_ssh/test.py::test_no_inserts_from_infile [gw8] [ 2%] PASSED test_ssh/test.py::test_no_inserts_from_infile test_ssh/test.py::test_no_queries_from_file [gw8] [ 3%] PASSED test_ssh/test.py::test_no_queries_from_file test_ssh/test.py::test_no_selects_into_outfile [gw1] [ 4%] PASSED test_select_access_rights/test_main.py::test_alias [gw8] [ 5%] PASSED test_ssh/test.py::test_no_selects_into_outfile test_select_access_rights/test_main.py::test_alias_columns [gw0] [ 6%] PASSED test_role/test.py::test_admin_option [gw1] [ 7%] PASSED test_select_access_rights/test_main.py::test_alias_columns test_role/test.py::test_changing_default_roles_affects_new_sessions_only test_select_access_rights/test_main.py::test_materialized_columns [gw4] [ 8%] PASSED test_partition/test.py::test_attach_check_all_parts test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster [gw0] [ 9%] PASSED test_role/test.py::test_changing_default_roles_affects_new_sessions_only test_partition/test.py::test_cannot_attach_active_part test_role/test.py::test_combine_privileges [gw1] [ 10%] PASSED test_select_access_rights/test_main.py::test_materialized_columns [gw4] [ 11%] PASSED test_partition/test.py::test_cannot_attach_active_part [gw5] [ 12%] PASSED test_refreshable_mv/test.py::test_adding_replica test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke test_select_access_rights/test_main.py::test_select_all_columns test_partition/test.py::test_detached_part_dir_exists [gw0] [ 13%] PASSED test_role/test.py::test_combine_privileges test_role/test.py::test_create_role [gw1] [ 14%] PASSED test_select_access_rights/test_main.py::test_select_all_columns test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant [gw0] [ 15%] PASSED test_role/test.py::test_create_role [gw4] [ 16%] PASSED test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts [gw1] [ 17%] PASSED test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant test_role/test.py::test_function_current_roles test_select_access_rights/test_main.py::test_select_count [gw6] [ 18%] SKIPPED test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary [gw6] [ 19%] SKIPPED test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary test_odbc_interaction/test.py::test_sqlite_simple_select_function_works [gw0] [ 20%] PASSED test_role/test.py::test_function_current_roles [gw6] [ 21%] SKIPPED test_odbc_interaction/test.py::test_sqlite_simple_select_function_works test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works test_role/test.py::test_grant_role_to_role [gw6] [ 22%] SKIPPED test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works test_odbc_interaction/test.py::test_sqlite_table_function [gw6] [ 23%] SKIPPED test_odbc_interaction/test.py::test_sqlite_table_function [gw1] [ 24%] PASSED test_select_access_rights/test_main.py::test_select_count [gw4] [ 25%] PASSED test_partition/test.py::test_drop_detached_parts test_select_access_rights/test_main.py::test_select_join [gw7] [ 26%] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_partition/test.py::test_make_clone_in_detached [gw0] [ 27%] PASSED test_role/test.py::test_grant_role_to_role [gw3] [ 28%] PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0] test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1] test_role/test.py::test_introspection [gw1] [ 29%] PASSED test_select_access_rights/test_main.py::test_select_join test_select_access_rights/test_main.py::test_select_prewhere [gw4] [ 30%] PASSED test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex [gw1] [ 31%] PASSED test_select_access_rights/test_main.py::test_select_prewhere test_select_access_rights/test_main.py::test_select_single_column test_s3_low_cardinality_right_border/test.py::test_s3_right_border [gw3] [ 32%] PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1] test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0] [gw7] [ 33%] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list [gw1] [ 34%] PASSED test_select_access_rights/test_main.py::test_select_single_column test_select_access_rights/test_main.py::test_select_single_column_with_table_grant [gw2] [ 35%] PASSED test_rename_column/test.py::test_rename_distributed [gw4] [ 36%] PASSED test_partition/test.py::test_partition_complex test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_partition/test.py::test_partition_simple [gw1] [ 37%] PASSED test_select_access_rights/test_main.py::test_select_single_column_with_table_grant [gw4] [ 38%] PASSED test_partition/test.py::test_partition_simple test_select_access_rights/test_main.py::test_select_union test_partition/test.py::test_system_detached_parts [gw0] [ 39%] PASSED test_role/test.py::test_introspection [gw3] [ 40%] PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0] test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1] test_role/test.py::test_revoke_requires_admin_option [gw1] [ 41%] PASSED test_select_access_rights/test_main.py::test_select_union test_select_access_rights/test_main.py::test_select_where [gw3] [ 42%] PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1] test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0] [gw7] [ 43%] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy [gw1] [ 44%] PASSED test_select_access_rights/test_main.py::test_select_where test_select_access_rights/test_main.py::test_select_with_row_policy [gw0] [ 45%] PASSED test_role/test.py::test_revoke_requires_admin_option [gw8] [ 46%] PASSED test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster test_role/test.py::test_role_expiration[False] [gw3] [ 47%] PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0] test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1] test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16] [gw9] [ 48%] PASSED test_recompression_ttl/test.py::test_recompression_multiple_ttls test_recompression_ttl/test.py::test_recompression_replicated [gw1] [ 49%] PASSED test_select_access_rights/test_main.py::test_select_with_row_policy [gw7] [ 50%] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy [gw6] [ 51%] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 [gw3] [ 52%] PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1] [gw8] [ 53%] PASSED test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16] [gw0] [ 54%] PASSED test_role/test.py::test_role_expiration[False] test_role/test.py::test_role_expiration[True] test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12] test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards [gw6] [ 55%] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 [gw7] [ 56%] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy [gw6] [ 57%] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 [gw4] [ 58%] PASSED test_partition/test.py::test_system_detached_parts [gw8] [ 59%] PASSED test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12] [gw9] [ 60%] PASSED test_recompression_ttl/test.py::test_recompression_replicated test_recompression_ttl/test.py::test_recompression_simple test_replicated_table_attach/test.py::test_startup_with_small_bg_pool [gw0] [ 61%] PASSED test_role/test.py::test_role_expiration[True] test_role/test.py::test_roles_cache [gw7] [ 62%] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_parallel_replicas_failover/test.py::test_skip_replicas_without_table test_part_uuid/test.py::test_part_uuid test_restore_external_engines/test.py::test_restore_table [gw0] [ 63%] PASSED test_role/test.py::test_roles_cache test_role/test.py::test_set_role [gw3] [ 64%] PASSED test_replicated_table_attach/test.py::test_startup_with_small_bg_pool test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] [gw0] [ 65%] PASSED test_role/test.py::test_set_role [gw1] [ 66%] PASSED test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards [gw9] [ 67%] PASSED test_recompression_ttl/test.py::test_recompression_simple test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach [gw4] [ 68%] PASSED test_parallel_replicas_failover/test.py::test_skip_replicas_without_table test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas [gw6] [ 69%] PASSED test_part_uuid/test.py::test_part_uuid test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop test_read_only_table/test.py::test_restart_zookeeper [gw0] [ 70%] PASSED test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach [gw4] [ 71%] PASSED test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas test_replicating_constants/test.py::test_different_versions [gw8] [ 72%] PASSED test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null [gw1] [ 73%] PASSED test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards [gw3] [ 74%] PASSED test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned test_remote_prewhere/test.py::test_remote test_shutdown_static_destructor_failure/test.py::test_shutdown [gw2] [ 75%] PASSED test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel [gw2] [ 76%] SKIPPED test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node [gw2] [ 77%] SKIPPED test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert [gw2] [ 78%] SKIPPED test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_range_hashed_dictionary_types/test.py::test_range_hashed_dict [gw2] [ 79%] SKIPPED test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select [gw2] [ 80%] SKIPPED test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert [gw2] [ 81%] SKIPPED test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete [gw2] [ 82%] SKIPPED test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move [gw2] [ 83%] SKIPPED test_rename_column/test.py::test_rename_with_parallel_ttl_move [gw9] [ 84%] PASSED test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop test_rocksdb_read_only/test.py::test_read_only [gw3] [ 85%] PASSED test_remote_prewhere/test.py::test_remote [gw8] [ 86%] PASSED test_restore_external_engines/test.py::test_restore_table_null [gw9] [ 87%] PASSED test_rocksdb_read_only/test.py::test_read_only [gw0] [ 88%] PASSED test_shutdown_static_destructor_failure/test.py::test_shutdown [gw4] [ 89%] PASSED test_replicating_constants/test.py::test_different_versions test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart [gw1] [ 90%] PASSED test_range_hashed_dictionary_types/test.py::test_range_hashed_dict [gw6] [ 91%] PASSED test_read_only_table/test.py::test_restart_zookeeper [gw7] [ 92%] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] [gw5] [ 93%] FAILED test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node test_replication_without_zookeeper/test.py::test_startup_without_zookeeper [gw7] [ 94%] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] [gw6] [ 95%] PASSED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper [gw8] [ 96%] PASSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart [gw5] [ 97%] FAILED test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db [gw5] [ 98%] FAILED test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db test_refreshable_mv/test.py::test_refreshable_mv_in_system_db [gw5] [ 99%] PASSED test_refreshable_mv/test.py::test_refreshable_mv_in_system_db test_refreshable_mv/test.py::test_replicated_db_startup_race [gw5] [100%] FAILED test_refreshable_mv/test.py::test_replicated_db_startup_race =================================== FAILURES =================================== ________________________ test_refresh_vs_shutdown_smoke ________________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_refresh_vs_shutdown_smoke(started_cluster): for node in nodes: node.query( "create database re engine = Replicated('/test/re', 'shard1', '{replica}');" ) node1.stop_clickhouse() num_tables = 2 for i in range(10): exec_id = node1.start_clickhouse() assert exec_id is not None if i == 0: node1.query("select '===test_refresh_vs_shutdown_smoke start==='") for j in range(num_tables): node1.query( f"create materialized view re.a{j} refresh every 1 second (x Int64) engine ReplicatedMergeTree order by x as select number*10 as x from numbers(2)" ) if randint(0, 1): for j in range(num_tables): if randint(0, 1): node1.query(f"system refresh view re.a{j}") r = randint(0, 2) if r == 1: time.sleep(randint(0, 10) / 1000) elif r == 2: time.sleep(randint(0, 100) / 1000) node1.stop_clickhouse(stop_wait_sec=300) while True: exit_code = cluster.docker_client.api.exec_inspect(exec_id)["ExitCode"] if exit_code is not None: assert exit_code == 0 break time.sleep(1) assert not node1.contains_in_log("view refreshes failed to stop", from_host=True) assert not node1.contains_in_log("Closed connections. But", from_host=True) assert not node1.contains_in_log("Will shutdown forcefully.", from_host=True) assert not node1.contains_in_log("##########", from_host=True) assert node1.contains_in_log( "===test_refresh_vs_shutdown_smoke start===", from_host=True ) node1.start_clickhouse() node1.query("drop database re sync") > node2.query("drop database re sync") test_refreshable_mv/test.py:336: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 210, stderr: Code: 210. DB::NetException: Net Exception: No route to host (172.16.4.6:9000). (NETWORK_ERROR) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-07-13 01:32:13 [ 699 ] DEBUG : Executing query create database re engine = Replicated('/test/re', 'shard1', '{replica}'); on node1 (cluster.py:3570, query) 2025-07-13 01:32:13 [ 699 ] DEBUG : Executing query create database re engine = Replicated('/test/re', 'shard1', '{replica}'); on node2 (cluster.py:3570, query) 2025-07-13 01:32:14 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:14 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:32:14 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:32:14 [ 699 ] DEBUG : Stdout: 8 ? 00:00:01 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:32:14 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:14 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:32:14 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:14 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:14 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:15 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:15 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:15 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:16 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:16 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:16 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:17 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:17 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:17 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:18 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:18 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:18 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:19 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:19 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:19 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:20 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:20 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:20 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:21 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:21 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:22 [ 699 ] DEBUG : Stdout:8 (cluster.py:145, run_and_check) 2025-07-13 01:32:23 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:23 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:23 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:23 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:23 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:32:23 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:32:23 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/9904599a9858029ffa8d78dec16dcec7c4333153b0cf6a3a36de1e4517c9efaa/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:32:23 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/9904599a9858029ffa8d78dec16dcec7c4333153b0cf6a3a36de1e4517c9efaa/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:32:24 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:24 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:24 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:24 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:32:24 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:24 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:24 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:24 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:25 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:26 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:27 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:28 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:28 [ 699 ] DEBUG : Executing query select '===test_refresh_vs_shutdown_smoke start===' on node1 (cluster.py:3570, query) 2025-07-13 01:32:29 [ 699 ] DEBUG : Executing query create materialized view re.a0 refresh every 1 second (x Int64) engine ReplicatedMergeTree order by x as select number*10 as x from numbers(2) on node1 (cluster.py:3570, query) 2025-07-13 01:32:29 [ 699 ] DEBUG : Executing query create materialized view re.a1 refresh every 1 second (x Int64) engine ReplicatedMergeTree order by x as select number*10 as x from numbers(2) on node1 (cluster.py:3570, query) 2025-07-13 01:32:31 [ 699 ] DEBUG : Executing query system refresh view re.a1 on node1 (cluster.py:3570, query) 2025-07-13 01:32:31 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:31 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:32:31 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:32:31 [ 699 ] DEBUG : Stdout: 818 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:32:31 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:31 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:32:31 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:31 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:31 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:32 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:32 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:32 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:33 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:33 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:33 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:34 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:34 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:34 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:35 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:35 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:36 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:37 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:37 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:37 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:38 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:38 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:38 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:39 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:39 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:39 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:40 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:40 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:40 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:41 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:41 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:41 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:42 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:42 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:42 [ 699 ] DEBUG : Stdout:818 (cluster.py:145, run_and_check) 2025-07-13 01:32:43 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:43 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:43 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/9904599a9858029ffa8d78dec16dcec7c4333153b0cf6a3a36de1e4517c9efaa/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:32:43 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:43 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:43 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:32:43 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:32:44 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/7fa2158e27c3014d2ba2bb0d800d388e6def6f08cb4d0a0541d03f97afacb1c2/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:32:44 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/7fa2158e27c3014d2ba2bb0d800d388e6def6f08cb4d0a0541d03f97afacb1c2/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:32:45 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:45 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:46 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:32:46 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:32:46 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:46 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:46 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:32:46 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:47 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:48 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:49 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:50 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:50 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:52 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:32:52 [ 699 ] DEBUG : Executing query system refresh view re.a0 on node1 (cluster.py:3570, query) 2025-07-13 01:32:53 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:53 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:32:53 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:32:53 [ 699 ] DEBUG : Stdout: 1694 ? 00:00:03 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:32:53 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:53 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:32:53 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:53 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:53 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:32:54 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:54 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:55 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:32:56 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:56 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:56 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:32:57 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:32:59 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:32:59 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:33:00 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:00 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:01 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:33:02 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:02 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:02 [ 699 ] DEBUG : Stdout:1694 (cluster.py:145, run_and_check) 2025-07-13 01:33:02 [ 699 ] DEBUG : Stdout:2482 (cluster.py:145, run_and_check) 2025-07-13 01:33:03 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:03 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:04 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/7fa2158e27c3014d2ba2bb0d800d388e6def6f08cb4d0a0541d03f97afacb1c2/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:33:04 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:04 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:04 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:33:04 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:33:04 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/c6ed6a41271a09d3433d8055a781a1d6f18a9a6749dcddeb317a290c7979a33c/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:33:04 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/c6ed6a41271a09d3433d8055a781a1d6f18a9a6749dcddeb317a290c7979a33c/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:33:05 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:05 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:05 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:05 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:33:05 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:05 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:06 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:06 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:06 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:07 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:08 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:11 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:11 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:12 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:13 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:14 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:14 [ 699 ] DEBUG : Executing query system refresh view re.a0 on node1 (cluster.py:3570, query) 2025-07-13 01:33:15 [ 699 ] DEBUG : Executing query system refresh view re.a1 on node1 (cluster.py:3570, query) 2025-07-13 01:33:15 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:15 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:33:15 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:33:15 [ 699 ] DEBUG : Stdout: 2519 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:33:15 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:15 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:33:16 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:16 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:16 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:17 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:17 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:17 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:18 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:18 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:18 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:19 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:19 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:19 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:20 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:20 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:20 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:21 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:21 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:21 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:22 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:22 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:23 [ 699 ] DEBUG : Stdout:2519 (cluster.py:145, run_and_check) 2025-07-13 01:33:24 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:24 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:24 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/c6ed6a41271a09d3433d8055a781a1d6f18a9a6749dcddeb317a290c7979a33c/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:33:24 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:24 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:24 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:33:24 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:33:24 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/8ca5a21ea17103b11d0a280dd2f14025551999519d3a4f8de8b6f91c9eea8690/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:33:24 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/8ca5a21ea17103b11d0a280dd2f14025551999519d3a4f8de8b6f91c9eea8690/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:33:25 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:25 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:25 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:25 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:33:25 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:25 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:25 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:25 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:26 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:27 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:28 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:31 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:34 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:34 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:33:35 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:33:35 [ 699 ] DEBUG : Stdout: 3361 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:33:35 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:35 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:33:35 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:35 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:35 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:36 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:36 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:36 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:37 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:37 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:38 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:39 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:39 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:39 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:40 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:40 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:40 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:41 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:41 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:41 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:42 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:42 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:42 [ 699 ] DEBUG : Stdout:3361 (cluster.py:145, run_and_check) 2025-07-13 01:33:42 [ 699 ] DEBUG : Stdout:4165 (cluster.py:145, run_and_check) 2025-07-13 01:33:43 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:46 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:46 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/8ca5a21ea17103b11d0a280dd2f14025551999519d3a4f8de8b6f91c9eea8690/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:33:46 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:46 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:46 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:33:46 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:33:46 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/5ed463f68370fb417b4365e7d6e5e7d5593ef8f879169d823d9e04a642f6d6d4/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:33:46 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/5ed463f68370fb417b4365e7d6e5e7d5593ef8f879169d823d9e04a642f6d6d4/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:33:47 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:47 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:48 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:33:48 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:33:48 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:33:48 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:33:48 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:33:48 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:48 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:51 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:52 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:52 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:55 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:33:59 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:00 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:01 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:01 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:34:02 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:34:02 [ 699 ] DEBUG : Stdout: 4202 ? 00:00:07 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:34:02 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:02 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:34:02 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:02 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:02 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:03 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:05 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:10 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:11 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:11 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:11 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:12 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:12 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:13 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:14 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:14 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:14 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:15 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:17 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:17 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:18 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:18 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:18 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:19 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:19 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:19 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:20 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:20 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:23 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:24 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:24 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:24 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:25 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:25 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:25 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:26 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:28 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:28 [ 699 ] DEBUG : Stdout:4202 (cluster.py:145, run_and_check) 2025-07-13 01:34:29 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:29 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:33 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/5ed463f68370fb417b4365e7d6e5e7d5593ef8f879169d823d9e04a642f6d6d4/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:34:33 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:33 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:33 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:34:33 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:34:33 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/4d7d378c8bd77499da49d2897e54d28826ae24508e09e6dce96de6f888cf0581/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:34:33 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/4d7d378c8bd77499da49d2897e54d28826ae24508e09e6dce96de6f888cf0581/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:34:34 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:34 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:34 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:34 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:34:34 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:34 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:34 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:34 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:35 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:36 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:37 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:38 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:39 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:40 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:40 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:40 [ 699 ] DEBUG : Executing query system refresh view re.a0 on node1 (cluster.py:3570, query) 2025-07-13 01:34:41 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:41 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:34:41 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:34:41 [ 699 ] DEBUG : Stdout: 5106 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:34:41 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:41 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:34:41 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:41 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:41 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:42 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:42 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:42 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:43 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:43 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:43 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:44 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:44 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:44 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:45 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:45 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:45 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:46 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:46 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:46 [ 699 ] DEBUG : Stdout:5106 (cluster.py:145, run_and_check) 2025-07-13 01:34:47 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:47 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:47 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/4d7d378c8bd77499da49d2897e54d28826ae24508e09e6dce96de6f888cf0581/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:34:47 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:47 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:47 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:34:47 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:34:47 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/6a7d9ecf5211242650485754d1d1f38db930706ad3d13b3554b4b9824590ecc6/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:34:47 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/6a7d9ecf5211242650485754d1d1f38db930706ad3d13b3554b4b9824590ecc6/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:34:48 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:48 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:49 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:49 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:34:49 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:49 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:49 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:49 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:49 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:50 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:51 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:51 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:51 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:34:51 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:34:51 [ 699 ] DEBUG : Stdout: 5944 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:34:51 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:51 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:34:51 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:51 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:51 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:52 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:52 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:52 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:53 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:53 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:53 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:54 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:54 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:54 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:55 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:55 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:55 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:56 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:56 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:56 [ 699 ] DEBUG : Stdout:5944 (cluster.py:145, run_and_check) 2025-07-13 01:34:57 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:57 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:57 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/6a7d9ecf5211242650485754d1d1f38db930706ad3d13b3554b4b9824590ecc6/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:34:57 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:57 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:58 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:34:58 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:34:58 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/9676e16cd769cad25af9b77722a0772d0e5b8fdc80658cc2f992d732fd0414ac/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:34:58 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/9676e16cd769cad25af9b77722a0772d0e5b8fdc80658cc2f992d732fd0414ac/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:34:59 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:59 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:59 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:34:59 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:34:59 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:34:59 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:34:59 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:34:59 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:34:59 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:00 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:01 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:01 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:01 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:35:01 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:35:01 [ 699 ] DEBUG : Stdout: 6779 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:35:01 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:01 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:35:01 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:01 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:01 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:35:02 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:02 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:02 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:35:03 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:03 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:03 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:35:04 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:04 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:05 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:35:06 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:06 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:06 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:35:07 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:07 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:07 [ 699 ] DEBUG : Stdout:6779 (cluster.py:145, run_and_check) 2025-07-13 01:35:08 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:08 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:08 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/9676e16cd769cad25af9b77722a0772d0e5b8fdc80658cc2f992d732fd0414ac/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:35:08 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:08 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:08 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:35:08 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:35:08 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/0a0bb3773134130954109fa0790d3fc54fc3257eac02bf09edd4e447af528e74/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:35:08 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/0a0bb3773134130954109fa0790d3fc54fc3257eac02bf09edd4e447af528e74/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:35:09 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:09 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:09 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:09 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:35:09 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:09 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:09 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:09 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:10 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:10 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:11 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:11 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:35:11 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:35:11 [ 699 ] DEBUG : Stdout: 7605 ? 00:00:04 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:35:11 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:11 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:35:11 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:11 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:11 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:12 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:12 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:12 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:13 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:13 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:13 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:14 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:14 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:14 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:15 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:15 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:15 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:16 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:16 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:16 [ 699 ] DEBUG : Stdout:7605 (cluster.py:145, run_and_check) 2025-07-13 01:35:17 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:17 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:17 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/0a0bb3773134130954109fa0790d3fc54fc3257eac02bf09edd4e447af528e74/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:35:17 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:17 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:18 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:35:18 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:35:18 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/d0c7fdd79b2698bbe8d63ae0fc41e88209bd07ff57bbcc9bffda9d69d03a6b45/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:35:18 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/d0c7fdd79b2698bbe8d63ae0fc41e88209bd07ff57bbcc9bffda9d69d03a6b45/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:35:19 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:19 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:19 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:19 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:35:19 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:19 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:19 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:19 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:19 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:21 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:21 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:35:21 [ 699 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2025-07-13 01:35:21 [ 699 ] DEBUG : Stdout: 8446 ? 00:00:07 clickhouse (cluster.py:145, run_and_check) 2025-07-13 01:35:21 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:21 [ 699 ] DEBUG : Command:[docker exec -u root roottestrefreshablemv-gw5-node1-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2025-07-13 01:35:22 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:22 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:22 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:23 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:23 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:23 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:24 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:24 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:24 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:25 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:25 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:25 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:26 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:26 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:26 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:27 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:27 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:27 [ 699 ] DEBUG : Stdout:8446 (cluster.py:145, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/d0c7fdd79b2698bbe8d63ae0fc41e88209bd07ff57bbcc9bffda9d69d03a6b45/json HTTP/1.1" 200 584 (connectionpool.py:547, _make_request) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log ] && zgrep -aH "view refreshes failed to stop" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log ] && zgrep -aH "Closed connections. But" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log ] && zgrep -aH "Will shutdown forcefully." /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log ] && zgrep -aH "##########" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log ] && zgrep -aH "===test_refresh_vs_shutdown_smoke start===" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log.8.gz:2025.07.13 01:32:28.964498 [ 828 ] {ebb222f1-f17f-4e1e-a1e8-acdcb4e0dde0} executeQuery: (from 172.16.4.1:61142) (query 1, line 1) select '===test_refresh_vs_shutdown_smoke start===' (stage: Complete) (cluster.py:145, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : Stdout:/ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/clickhouse-server.log.8.gz:2025.07.13 01:32:28.964610 [ 828 ] {ebb222f1-f17f-4e1e-a1e8-acdcb4e0dde0} CancellationChecker: Did not add the task because the timeout is 0. Query: select '===test_refresh_vs_shutdown_smoke start===' (cluster.py:145, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:28 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:28 [ 699 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3936, start_clickhouse) 2025-07-13 01:35:28 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottestrefreshablemv-gw5-node1-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2025-07-13 01:35:28 [ 699 ] DEBUG : http://localhost:None "POST /v1.46/exec/bdf64f569d57d80e644617fe2a8ec1f207900531d02fa3de981610099a3d38e8/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-07-13 01:35:28 [ 699 ] DEBUG : http://localhost:None "GET /v1.46/exec/bdf64f569d57d80e644617fe2a8ec1f207900531d02fa3de981610099a3d38e8/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2025-07-13 01:35:29 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:29 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:29 [ 699 ] DEBUG : Stdout:9277 (cluster.py:145, run_and_check) 2025-07-13 01:35:29 [ 699 ] DEBUG : Clickhouse process running. (cluster.py:3950, start_clickhouse) 2025-07-13 01:35:29 [ 699 ] DEBUG : run container_id:roottestrefreshablemv-gw5-node1-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2045, exec_in_container) 2025-07-13 01:35:29 [ 699 ] DEBUG : Command:[docker exec roottestrefreshablemv-gw5-node1-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2025-07-13 01:35:29 [ 699 ] DEBUG : Stdout:9277 (cluster.py:145, run_and_check) 2025-07-13 01:35:29 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:30 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:31 [ 699 ] DEBUG : Executing query select 20 on node1 (cluster.py:3570, query) 2025-07-13 01:35:31 [ 699 ] DEBUG : Executing query drop database re sync on node1 (cluster.py:3570, query) 2025-07-13 01:35:31 [ 699 ] DEBUG : Executing query drop database re sync on node2 (cluster.py:3570, query) ____________________ test_refreshable_mv_in_read_only_node _____________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_refreshable_mv_in_read_only_node(started_cluster): # writable node node1.query( "create database re engine = Replicated('/test/re', 'shard1', '{replica}');" ) # read_only node reading_node.query( "create database re engine = Replicated('/test/re', 'shard1', '{replica}');" ) # disable view sync on writable node, see if there's RefreshTask on read_only node node1.query( "system stop view sync" ) # clear text_log ensure all logs are related to this test reading_node.query( "system flush logs;" "truncate table system.text_log;" ) # this MV will be replicated to read_only node > node1.query( "create materialized view re.a refresh every 1 second (x Int64) engine ReplicatedMergeTree order by x as select number*10 as x from numbers(2)" ) test_refreshable_mv/test.py:255: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 85, stderr: Received exception from server (version 25.3.3): E Code: 341. DB::Exception: Received from 172.16.4.5:9000. DB::Exception: Cannot provide query execution status. The query's node /test/re/log/query-0000000476 has been deleted by the cleaner since it was finished (or its lifetime is expired). Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x00000000381dd971 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bc293d1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000c2c620b E 3. ./src/Common/Exception.h:130: DB::DistributedQueryStatusSource::generate() @ 0x00000000296e684c E 4. ./build_docker/./src/Processors/ISource.cpp:139: DB::ISource::tryGenerate() @ 0x000000002fe32fb7 E 5. ./build_docker/./src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000002fe325a4 E 6. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:53: DB::ExecutionThreadContext::executeTask() @ 0x000000002fe72234 E 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:296: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000002fe52d80 E 8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:262: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000002fe512fc E 9. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:128: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000002fe50ad8 E 10. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:76: void std::__function::__policy_invoker::__call_impl[abi:ne190107]::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000002fe7a36d E 11. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001bef3bd1 E 12. ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: void* std::__thread_proxy[abi:ne190107]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000001bf02030 E 13. asan_thread_start(void*) @ 0x000000000c278e77 E 14. ? @ 0x00007fa194202ac3 E 15. ? @ 0x00007fa194294850 E E Job's origin stack trace: E 0. ./build_docker/./src/Common/StackTrace.cpp:386: StackTrace::StackTrace() @ 0x000000001bd908c7 E 1. ./build_docker/./src/Common/ThreadPool.cpp:130: void boost::heap::priority_queue, boost::parameter::void_, boost::parameter::void_, boost::parameter::void_>::emplace, Priority&, StrongTypedef&, DB::OpenTelemetry::TracingContextOnThread const, bool&, (anonymous namespace)::ScopedDecrement>(std::function&&, Priority&, StrongTypedef&, DB::OpenTelemetry::TracingContextOnThread const&&, bool&, (anonymous namespace)::ScopedDecrement&&) @ 0x000000001bef2184 E 2. ./build_docker/./src/Common/ThreadPool.cpp:401: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x000000001bef6a2a E 3. ./build_docker/./src/Common/ThreadPool.cpp:506: ThreadPoolImpl::scheduleOrThrow(std::function, Priority, unsigned long, bool) @ 0x000000001bef749d E 4. ./src/Common/ThreadPool.h:279: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000002fe77fa7 E 5. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:131: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000002fe789bc E 6. ./build_docker/./src/Server/TCPHandler.cpp:1236: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000002fc5d37c E 7. ./build_docker/./src/Server/TCPHandler.cpp:677: DB::TCPHandler::runImpl() @ 0x000000002fc42380 E 8. ./build_docker/./src/Server/TCPHandler.cpp:2628: DB::TCPHandler::run() @ 0x000000002fc81dda E 9. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x00000000383b8c6f E 10. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000383b9937 E 11. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x00000000382c828b E 12. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000382c1e88 E 13. asan_thread_start(void*) @ 0x000000000c278e77 E 14. ? @ 0x00007fa194202ac3 E 15. ? @ 0x00007fa194294850 E . (UNFINISHED) E (query: create materialized view re.a refresh every 1 second (x Int64) engine ReplicatedMergeTree order by x as select number*10 as x from numbers(2)) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-07-13 01:35:35 [ 699 ] DEBUG : Executing query create database re engine = Replicated('/test/re', 'shard1', '{replica}'); on node1 (cluster.py:3570, query) 2025-07-13 01:35:35 [ 699 ] DEBUG : Executing query create database re engine = Replicated('/test/re', 'shard1', '{replica}'); on reading_node (cluster.py:3570, query) 2025-07-13 01:35:35 [ 699 ] DEBUG : Executing query system stop view sync on node1 (cluster.py:3570, query) 2025-07-13 01:35:36 [ 699 ] DEBUG : Executing query system flush logs;truncate table system.text_log; on reading_node (cluster.py:3570, query) 2025-07-13 01:35:36 [ 699 ] DEBUG : Executing query create materialized view re.a refresh every 1 second (x Int64) engine ReplicatedMergeTree order by x as select number*10 as x from numbers(2) on node1 (cluster.py:3570, query) _____________________ test_refreshable_mv_in_replicated_db _____________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_refreshable_mv_in_replicated_db(started_cluster): for node in nodes: > node.query( "create database re engine = Replicated('/test/re', 'shard1', '{replica}');" ) test_refreshable_mv/test.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 82, stderr: Received exception from server (version 25.3.3): E Code: 82. DB::Exception: Received from 172.16.4.5:9000. DB::Exception: Database re already exists.. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x00000000381dd971 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bc293d1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000c2c620b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000c2fb438 E 4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:204: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000002a1fd72b E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2343: DB::InterpreterCreateQuery::execute() @ 0x000000002a23acfb E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1457: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002aad7ac3 E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1624: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002aacfa05 E 8. ./build_docker/./src/Server/TCPHandler.cpp:663: DB::TCPHandler::runImpl() @ 0x000000002fc42116 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2628: DB::TCPHandler::run() @ 0x000000002fc81dda E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x00000000383b8c6f E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000383b9937 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x00000000382c828b E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000382c1e88 E 14. asan_thread_start(void*) @ 0x000000000c278e77 E 15. ? @ 0x00007fa194202ac3 E 16. ? @ 0x00007fa194294850 E . (DATABASE_ALREADY_EXISTS) E (query: create database re engine = Replicated('/test/re', 'shard1', '{replica}');) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-07-13 01:37:41 [ 699 ] DEBUG : Executing query create database re engine = Replicated('/test/re', 'shard1', '{replica}'); on node1 (cluster.py:3570, query) _______________________ test_replicated_db_startup_race ________________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_replicated_db_startup_race(started_cluster): for node in nodes: > node.query( "create database re engine = Replicated('/test/re', 'shard1', '{replica}');" ) test_refreshable_mv/test.py:364: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3571: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 82, stderr: Received exception from server (version 25.3.3): E Code: 82. DB::Exception: Received from 172.16.4.5:9000. DB::Exception: Database re already exists.. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x00000000381dd971 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bc293d1 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000c2c620b E 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String&) @ 0x000000000c2fb438 E 4. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:204: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000002a1fd72b E 5. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2343: DB::InterpreterCreateQuery::execute() @ 0x000000002a23acfb E 6. ./build_docker/./src/Interpreters/executeQuery.cpp:1457: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002aad7ac3 E 7. ./build_docker/./src/Interpreters/executeQuery.cpp:1624: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002aacfa05 E 8. ./build_docker/./src/Server/TCPHandler.cpp:663: DB::TCPHandler::runImpl() @ 0x000000002fc42116 E 9. ./build_docker/./src/Server/TCPHandler.cpp:2628: DB::TCPHandler::run() @ 0x000000002fc81dda E 10. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x00000000383b8c6f E 11. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000383b9937 E 12. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x00000000382c828b E 13. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000382c1e88 E 14. asan_thread_start(void*) @ 0x000000000c278e77 E 15. ? @ 0x00007f931551eac3 E 16. ? @ 0x00007f93155b0850 E . (DATABASE_ALREADY_EXISTS) E (query: create database re engine = Replicated('/test/re', 'shard1', '{replica}');) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2025-07-13 01:37:56 [ 699 ] DEBUG : Executing query create database re engine = Replicated('/test/re', 'shard1', '{replica}'); on node1 (cluster.py:3570, query) ---------------------------- Captured log teardown ----------------------------- 2025-07-13 01:37:56 [ 699 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/.env --project-name roottestrefreshablemv-gw5 --file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/reading_node/docker-compose.yml stop --timeout 20] (cluster.py:121, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node1-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node2-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-reading_node-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node2-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node1-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-reading_node-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo2-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo3-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo1-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo1-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo3-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo2-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/reading_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/reading_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/.env --project-name roottestrefreshablemv-gw5 --file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_refreshable_mv/_instances-0-gw5/reading_node/docker-compose.yml down --volumes] (cluster.py:121, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node1-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-reading_node-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node2-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node1-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node1-1 Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node2-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node2-1 Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-reading_node-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-reading_node-1 Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node1-1 Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-node2-1 Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-reading_node-1 Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo2-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo3-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo1-1 Stopping (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo2-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo2-1 Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo3-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo3-1 Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo1-1 Stopped (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo1-1 Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo3-1 Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo2-1 Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Container roottestrefreshablemv-gw5-zoo1-1 Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Network roottestrefreshablemv-gw5_default Removing (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Stderr: Network roottestrefreshablemv-gw5_default Removed (cluster.py:147, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:38:09 [ 699 ] DEBUG : Docker networks for project roottestrefreshablemv-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:38:09 [ 699 ] DEBUG : Docker containers for project roottestrefreshablemv-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:38:09 [ 699 ] DEBUG : Docker volumes for project roottestrefreshablemv-gw5 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:38:09 [ 699 ] DEBUG : Command:[docker container list --all --filter name='^/roottestrefreshablemv-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:38:09 [ 699 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:38:09 [ 699 ] DEBUG : No running containers for project: roottestrefreshablemv-gw5 (cluster.py:874, cleanup) 2025-07-13 01:38:09 [ 699 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:38:10 [ 699 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:38:10 [ 699 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:38:10 [ 699 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:38:10 [ 699 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:38:10 [ 699 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:38:10 [ 699 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:38:10 [ 699 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:38:10 [ 699 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) =============================== warnings summary =============================== test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy /usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host '172.16.9.4'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ----------------- generated report log file: parallel2_0.jsonl ----------------- ============================== slowest durations =============================== 201.21s call test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke 154.99s call test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 125.87s call test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node 83.07s setup test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 83.04s setup test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 64.77s call test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned 58.98s setup test_restore_external_engines/test.py::test_restore_table 58.22s call test_recompression_ttl/test.py::test_recompression_simple 48.66s call test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards 46.95s setup test_parallel_replicas_failover/test.py::test_skip_replicas_without_table 44.69s setup test_part_uuid/test.py::test_part_uuid 41.75s call test_recompression_ttl/test.py::test_recompression_multiple_ttls 36.34s call test_partition/test.py::test_system_detached_parts 34.08s setup test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards 32.39s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 31.13s teardown test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12] 28.91s teardown test_role/test.py::test_set_role 27.99s setup test_read_only_table/test.py::test_restart_zookeeper 27.57s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border 27.25s call test_role/test.py::test_roles_cache 26.81s setup test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster 26.80s setup test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary 26.46s teardown test_recompression_ttl/test.py::test_recompression_simple 26.07s call test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards 25.53s call test_parallel_replicas_failover/test.py::test_skip_replicas_without_table 25.25s call test_recompression_ttl/test.py::test_recompression_replicated 24.12s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 23.86s setup test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0] 22.58s call test_rename_column/test.py::test_rename_distributed 21.65s setup test_recompression_ttl/test.py::test_recompression_multiple_ttls 21.45s teardown test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 21.41s teardown test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 20.53s setup test_rename_column/test.py::test_rename_distributed 19.23s setup test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 19.15s call test_replicated_table_attach/test.py::test_startup_with_small_bg_pool 18.72s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy 18.49s teardown test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 18.31s setup test_replicating_constants/test.py::test_different_versions 18.09s setup test_refreshable_mv/test.py::test_adding_replica 17.66s setup test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 16.77s call test_read_only_table/test.py::test_restart_zookeeper 16.65s teardown test_select_access_rights/test_main.py::test_select_with_row_policy 16.51s call test_part_uuid/test.py::test_part_uuid 16.42s teardown test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1] 16.15s setup test_replicated_table_attach/test.py::test_startup_with_small_bg_pool 15.81s setup test_partition/test.py::test_attach_check_all_parts 15.46s call test_restore_external_engines/test.py::test_restore_table_null 15.23s call test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster 14.95s call test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop 14.92s call test_refreshable_mv/test.py::test_refreshable_mv_in_system_db 14.45s setup test_role/test.py::test_admin_option 14.34s call test_role/test.py::test_introspection 14.19s setup test_range_hashed_dictionary_types/test.py::test_range_hashed_dict 13.93s call test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy 13.78s call test_role/test.py::test_role_expiration[False] 13.73s call test_role/test.py::test_revoke_requires_admin_option 13.57s setup test_ssh/test.py::test_create_table 13.35s setup test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop 13.32s setup test_select_access_rights/test_main.py::test_alias 13.31s call test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 13.28s call test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 13.27s call test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy 13.16s teardown test_refreshable_mv/test.py::test_replicated_db_startup_race 12.93s call test_role/test.py::test_role_expiration[True] 12.12s call test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 12.04s call test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16] 12.03s call test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 11.77s teardown test_odbc_interaction/test.py::test_sqlite_table_function 11.74s call test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 11.47s call test_restore_external_engines/test.py::test_restore_table 11.46s teardown test_rename_column/test.py::test_rename_with_parallel_ttl_move 11.33s call test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1] 11.11s call test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 11.07s call test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy 10.25s call test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas 10.09s teardown test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards 9.93s teardown test_partition/test.py::test_system_detached_parts 9.83s teardown test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas 9.12s call test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0] 9.05s call test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1] 8.99s teardown test_restore_external_engines/test.py::test_restore_table_null 8.10s call test_partition/test.py::test_make_clone_in_detached 8.03s call test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12] 7.63s setup test_remote_prewhere/test.py::test_remote 7.61s call test_role/test.py::test_set_role 7.45s call test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0] 7.41s teardown test_read_only_table/test.py::test_restart_zookeeper 7.27s call test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1] 7.25s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 7.06s teardown test_remote_prewhere/test.py::test_remote 6.60s teardown test_replicating_constants/test.py::test_different_versions 6.59s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border 6.55s teardown test_part_uuid/test.py::test_part_uuid 6.49s setup test_shutdown_static_destructor_failure/test.py::test_shutdown 6.36s call test_select_access_rights/test_main.py::test_select_with_row_policy 6.25s call test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0] 5.95s call test_select_access_rights/test_main.py::test_select_where 5.73s call test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart 4.69s teardown test_ssh/test.py::test_no_selects_into_outfile 4.33s call test_select_access_rights/test_main.py::test_select_join 3.76s teardown test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16] 3.66s call test_partition/test.py::test_detached_part_dir_exists 3.65s call test_shutdown_static_destructor_failure/test.py::test_shutdown 3.57s call test_select_access_rights/test_main.py::test_select_prewhere 3.56s call test_partition/test.py::test_partition_complex 3.51s call test_select_access_rights/test_main.py::test_select_union 3.51s teardown test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned 3.27s call test_select_access_rights/test_main.py::test_select_count 3.26s call test_partition/test.py::test_drop_detached_parts 3.20s call test_rocksdb_read_only/test.py::test_read_only 3.12s call test_partition/test.py::test_attach_check_all_parts 3.02s call test_role/test.py::test_admin_option 3.00s call test_refreshable_mv/test.py::test_adding_replica 2.89s call test_role/test.py::test_grant_role_to_role 2.76s call test_select_access_rights/test_main.py::test_alias_columns 2.64s call test_role/test.py::test_combine_privileges 2.57s teardown test_role/test.py::test_role_expiration[False] 2.33s call test_role/test.py::test_function_current_roles 2.30s call test_select_access_rights/test_main.py::test_select_single_column 2.28s teardown test_range_hashed_dictionary_types/test.py::test_range_hashed_dict 2.21s teardown test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster 2.19s call test_select_access_rights/test_main.py::test_materialized_columns 2.19s teardown test_shutdown_static_destructor_failure/test.py::test_shutdown 2.17s setup test_partition/test.py::test_system_detached_parts 2.13s call test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 1.98s teardown test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 1.94s call test_select_access_rights/test_main.py::test_select_all_columns 1.91s call test_role/test.py::test_create_role 1.85s call test_select_access_rights/test_main.py::test_select_single_column_with_table_grant 1.54s teardown test_rocksdb_read_only/test.py::test_read_only 1.38s setup test_partition/test.py::test_drop_detached_parts 1.36s setup test_partition/test.py::test_partition_complex 1.35s teardown test_role/test.py::test_grant_role_to_role 1.27s setup test_partition/test.py::test_partition_simple 1.26s call test_role/test.py::test_changing_default_roles_affects_new_sessions_only 1.10s teardown test_role/test.py::test_revoke_requires_admin_option 1.07s teardown test_role/test.py::test_roles_cache 1.00s call test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant 0.97s call test_select_access_rights/test_main.py::test_alias 0.92s teardown test_select_access_rights/test_main.py::test_select_single_column 0.90s call test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach 0.89s call test_partition/test.py::test_partition_simple 0.85s setup test_partition/test.py::test_cannot_attach_active_part 0.76s call test_partition/test.py::test_cannot_attach_active_part 0.74s call test_range_hashed_dictionary_types/test.py::test_range_hashed_dict 0.68s teardown test_select_access_rights/test_main.py::test_select_where 0.67s teardown test_select_access_rights/test_main.py::test_select_join 0.64s teardown test_partition/test.py::test_drop_detached_parts 0.64s teardown test_select_access_rights/test_main.py::test_select_single_column_with_table_grant 0.64s teardown test_select_access_rights/test_main.py::test_select_union 0.60s teardown test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant 0.59s teardown test_select_access_rights/test_main.py::test_select_prewhere 0.59s teardown test_select_access_rights/test_main.py::test_select_count 0.57s call test_ssh/test.py::test_create_table 0.57s call test_replicating_constants/test.py::test_different_versions 0.54s teardown test_role/test.py::test_create_role 0.50s teardown test_role/test.py::test_introspection 0.49s call test_rename_column/test.py::test_rename_with_parallel_select 0.49s call test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.48s call test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.48s teardown test_select_access_rights/test_main.py::test_alias_columns 0.47s teardown test_role/test.py::test_role_expiration[True] 0.47s call test_remote_prewhere/test.py::test_remote 0.45s setup test_select_access_rights/test_main.py::test_select_single_column_with_table_grant 0.43s teardown test_select_access_rights/test_main.py::test_select_all_columns 0.43s teardown test_role/test.py::test_combine_privileges 0.43s teardown test_role/test.py::test_admin_option 0.43s teardown test_select_access_rights/test_main.py::test_alias 0.43s teardown test_role/test.py::test_function_current_roles 0.43s teardown test_select_access_rights/test_main.py::test_materialized_columns 0.43s teardown test_role/test.py::test_changing_default_roles_affects_new_sessions_only 0.43s teardown test_partition/test.py::test_attach_check_all_parts 0.43s call test_rename_column/test.py::test_rename_with_parallel_merges 0.37s call test_rename_column/test.py::test_rename_parallel_same_node 0.36s call test_rename_column/test.py::test_rename_with_parallel_ttl_move 0.34s setup test_select_access_rights/test_main.py::test_select_union 0.32s call test_odbc_interaction/test.py::test_sqlite_table_function 0.32s setup test_select_access_rights/test_main.py::test_select_where 0.32s setup test_select_access_rights/test_main.py::test_select_single_column 0.32s setup test_select_access_rights/test_main.py::test_materialized_columns 0.32s call test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary 0.28s call test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works 0.28s teardown test_partition/test.py::test_partition_complex 0.27s call test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary 0.27s call test_rename_column/test.py::test_rename_with_parallel_insert 0.27s call test_rename_column/test.py::test_rename_parallel 0.27s setup test_select_access_rights/test_main.py::test_select_prewhere 0.24s setup test_select_access_rights/test_main.py::test_select_with_row_policy 0.22s setup test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant 0.22s teardown test_partition/test.py::test_partition_simple 0.22s call test_odbc_interaction/test.py::test_sqlite_simple_select_function_works 0.22s teardown test_partition/test.py::test_cannot_attach_active_part 0.22s setup test_select_access_rights/test_main.py::test_alias_columns 0.22s setup test_select_access_rights/test_main.py::test_select_all_columns 0.22s call test_refreshable_mv/test.py::test_replicated_db_startup_race 0.22s setup test_select_access_rights/test_main.py::test_select_join 0.22s call test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db 0.18s setup test_select_access_rights/test_main.py::test_select_count 0.11s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy 0.06s call test_ssh/test.py::test_no_selects_into_outfile 0.05s call test_ssh/test.py::test_no_inserts_from_infile 0.05s call test_ssh/test.py::test_no_queries_from_file 0.03s setup test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.02s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border 0.01s teardown test_recompression_ttl/test.py::test_recompression_multiple_ttls 0.01s teardown test_rename_column/test.py::test_rename_distributed 0.01s setup test_recompression_ttl/test.py::test_recompression_replicated 0.01s setup test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas 0.01s teardown test_parallel_replicas_failover/test.py::test_skip_replicas_without_table 0.01s setup test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards 0.00s teardown test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0] 0.00s teardown test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards 0.00s teardown test_replicated_table_attach/test.py::test_startup_with_small_bg_pool 0.00s setup test_partition/test.py::test_make_clone_in_detached 0.00s teardown test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop 0.00s teardown test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0] 0.00s setup test_role/test.py::test_role_expiration[False] 0.00s setup test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1] 0.00s teardown test_recompression_ttl/test.py::test_recompression_replicated 0.00s setup test_recompression_ttl/test.py::test_recompression_simple 0.00s teardown test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] 0.00s setup test_role/test.py::test_revoke_requires_admin_option 0.00s setup test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16] 0.00s setup test_rocksdb_read_only/test.py::test_read_only 0.00s setup test_role/test.py::test_role_expiration[True] 0.00s setup test_role/test.py::test_set_role 0.00s setup test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned 0.00s teardown test_restore_external_engines/test.py::test_restore_table 0.00s setup test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1] 0.00s setup test_rename_column/test.py::test_rename_parallel 0.00s teardown test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy 0.00s setup test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy 0.00s teardown test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0] 0.00s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy 0.00s teardown test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 0.00s setup test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12] 0.00s setup test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1] 0.00s setup test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] 0.00s setup test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0] 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy 0.00s teardown test_ssh/test.py::test_no_inserts_from_infile 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 0.00s setup test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 0.00s teardown test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1] 0.00s setup test_restore_external_engines/test.py::test_restore_table_null 0.00s teardown test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works 0.00s setup test_partition/test.py::test_detached_part_dir_exists 0.00s teardown test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 0.00s teardown test_partition/test.py::test_make_clone_in_detached 0.00s teardown test_refreshable_mv/test.py::test_adding_replica 0.00s setup test_role/test.py::test_changing_default_roles_affects_new_sessions_only 0.00s setup test_role/test.py::test_combine_privileges 0.00s setup test_refreshable_mv/test.py::test_replicated_db_startup_race 0.00s setup test_ssh/test.py::test_no_queries_from_file 0.00s setup test_role/test.py::test_introspection 0.00s setup test_rename_column/test.py::test_rename_with_parallel_insert 0.00s setup test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0] 0.00s teardown test_ssh/test.py::test_no_queries_from_file 0.00s setup test_role/test.py::test_create_role 0.00s setup test_role/test.py::test_grant_role_to_role 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 0.00s setup test_rename_column/test.py::test_rename_with_parallel_merges 0.00s setup test_odbc_interaction/test.py::test_sqlite_table_function 0.00s setup test_role/test.py::test_roles_cache 0.00s setup test_odbc_interaction/test.py::test_sqlite_simple_select_function_works 0.00s teardown test_rename_column/test.py::test_rename_parallel_same_node 0.00s teardown test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1] 0.00s teardown test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary 0.00s setup test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_insert 0.00s setup test_role/test.py::test_function_current_roles 0.00s teardown test_odbc_interaction/test.py::test_sqlite_simple_select_function_works 0.00s setup test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 0.00s teardown test_partition/test.py::test_detached_part_dir_exists 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_merges 0.00s teardown test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db 0.00s teardown test_refreshable_mv/test.py::test_refreshable_mv_in_system_db 0.00s setup test_ssh/test.py::test_no_selects_into_outfile 0.00s setup test_refreshable_mv/test.py::test_refreshable_mv_in_system_db 0.00s setup test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke 0.00s setup test_rename_column/test.py::test_rename_with_parallel_select 0.00s teardown test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node 0.00s teardown test_rename_column/test.py::test_rename_parallel 0.00s setup test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_ttl_delete 0.00s teardown test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary 0.00s setup test_ssh/test.py::test_no_inserts_from_infile 0.00s setup test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node 0.00s setup test_rename_column/test.py::test_rename_parallel_same_node 0.00s setup test_rename_column/test.py::test_rename_with_parallel_ttl_move 0.00s teardown test_ssh/test.py::test_create_table 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_slow_insert 0.00s setup test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db 0.00s teardown test_rename_column/test.py::test_rename_with_parallel_select =========================== short test summary info ============================ FAILED test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke - helpers.... FAILED test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node - h... FAILED test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db - he... FAILED test_refreshable_mv/test.py::test_replicated_db_startup_race - helpers... PASSED test_ssh/test.py::test_create_table PASSED test_ssh/test.py::test_no_inserts_from_infile PASSED test_ssh/test.py::test_no_queries_from_file PASSED test_select_access_rights/test_main.py::test_alias PASSED test_ssh/test.py::test_no_selects_into_outfile PASSED test_role/test.py::test_admin_option PASSED test_select_access_rights/test_main.py::test_alias_columns PASSED test_partition/test.py::test_attach_check_all_parts PASSED test_role/test.py::test_changing_default_roles_affects_new_sessions_only PASSED test_select_access_rights/test_main.py::test_materialized_columns PASSED test_partition/test.py::test_cannot_attach_active_part PASSED test_refreshable_mv/test.py::test_adding_replica PASSED test_role/test.py::test_combine_privileges PASSED test_select_access_rights/test_main.py::test_select_all_columns PASSED test_role/test.py::test_create_role PASSED test_partition/test.py::test_detached_part_dir_exists PASSED test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant PASSED test_role/test.py::test_function_current_roles PASSED test_select_access_rights/test_main.py::test_select_count PASSED test_partition/test.py::test_drop_detached_parts PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy PASSED test_role/test.py::test_grant_role_to_role PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0] PASSED test_select_access_rights/test_main.py::test_select_join PASSED test_partition/test.py::test_make_clone_in_detached PASSED test_select_access_rights/test_main.py::test_select_prewhere PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy PASSED test_select_access_rights/test_main.py::test_select_single_column PASSED test_rename_column/test.py::test_rename_distributed PASSED test_partition/test.py::test_partition_complex PASSED test_select_access_rights/test_main.py::test_select_single_column_with_table_grant PASSED test_partition/test.py::test_partition_simple PASSED test_role/test.py::test_introspection PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0] PASSED test_select_access_rights/test_main.py::test_select_union PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list PASSED test_select_access_rights/test_main.py::test_select_where PASSED test_role/test.py::test_revoke_requires_admin_option PASSED test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0] PASSED test_recompression_ttl/test.py::test_recompression_multiple_ttls PASSED test_select_access_rights/test_main.py::test_select_with_row_policy PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border PASSED test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1] PASSED test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16] PASSED test_role/test.py::test_role_expiration[False] PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy PASSED test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 PASSED test_partition/test.py::test_system_detached_parts PASSED test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12] PASSED test_recompression_ttl/test.py::test_recompression_replicated PASSED test_role/test.py::test_role_expiration[True] PASSED test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy PASSED test_role/test.py::test_roles_cache PASSED test_replicated_table_attach/test.py::test_startup_with_small_bg_pool PASSED test_role/test.py::test_set_role PASSED test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards PASSED test_recompression_ttl/test.py::test_recompression_simple PASSED test_parallel_replicas_failover/test.py::test_skip_replicas_without_table PASSED test_part_uuid/test.py::test_part_uuid PASSED test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach PASSED test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas PASSED test_restore_external_engines/test.py::test_restore_table PASSED test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards PASSED test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned PASSED test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select PASSED test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop PASSED test_remote_prewhere/test.py::test_remote PASSED test_restore_external_engines/test.py::test_restore_table_null PASSED test_rocksdb_read_only/test.py::test_read_only PASSED test_shutdown_static_destructor_failure/test.py::test_shutdown PASSED test_replicating_constants/test.py::test_different_versions PASSED test_range_hashed_dictionary_types/test.py::test_range_hashed_dict PASSED test_read_only_table/test.py::test_restart_zookeeper PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3] PASSED test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver] PASSED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper PASSED test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart PASSED test_refreshable_mv/test.py::test_refreshable_mv_in_system_db SKIPPED [5] test_odbc_interaction/test.py:57: Sanitizers cannot work with third-party shared libraries SKIPPED [1] test_rename_column/test.py:338: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:297: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:433: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:489: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:380: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:555: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:670: Consume tons of memory with sanitizer SKIPPED [1] test_rename_column/test.py:596: Consume tons of memory with sanitizer ======= 4 failed, 83 passed, 13 skipped, 7 warnings in 389.46s (0:06:29) ======= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_35h8wy --privileged --dns-search='.' --memory=30709035008 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel2_0.jsonl --report-log-exclude-logs-on-passed-tests test_odbc_interaction/test.py::test_sqlite_odbc_cached_dictionary test_odbc_interaction/test.py::test_sqlite_odbc_hashed_dictionary test_odbc_interaction/test.py::test_sqlite_simple_select_function_works test_odbc_interaction/test.py::test_sqlite_simple_select_storage_works test_odbc_interaction/test.py::test_sqlite_table_function test_parallel_replicas_failover/test.py::test_skip_replicas_without_table test_parallel_replicas_failover/test.py::test_skip_unresponsive_replicas 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-0]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[100-1]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-0]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[2-1]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-0]' 'test_parallel_replicas_no_replicas/test.py::test_skip_all_replicas[3-1]' test_parallel_replicas_skip_shards/test.py::test_error_on_unavailable_shards test_parallel_replicas_skip_shards/test.py::test_skip_unavailable_shards test_part_uuid/test.py::test_part_uuid test_partition/test.py::test_attach_check_all_parts test_partition/test.py::test_cannot_attach_active_part test_partition/test.py::test_detached_part_dir_exists test_partition/test.py::test_drop_detached_parts test_partition/test.py::test_make_clone_in_detached test_partition/test.py::test_partition_complex test_partition/test.py::test_partition_simple test_partition/test.py::test_system_detached_parts test_range_hashed_dictionary_types/test.py::test_range_hashed_dict test_read_only_table/test.py::test_restart_zookeeper test_recompression_ttl/test.py::test_recompression_multiple_ttls test_recompression_ttl/test.py::test_recompression_replicated test_recompression_ttl/test.py::test_recompression_simple test_refreshable_mv/test.py::test_adding_replica test_refreshable_mv/test.py::test_refresh_vs_shutdown_smoke test_refreshable_mv/test.py::test_refreshable_mv_in_read_only_node test_refreshable_mv/test.py::test_refreshable_mv_in_replicated_db test_refreshable_mv/test.py::test_refreshable_mv_in_system_db test_refreshable_mv/test.py::test_replicated_db_startup_race test_remote_prewhere/test.py::test_remote test_rename_column/test.py::test_rename_distributed test_rename_column/test.py::test_rename_distributed_parallel_insert_and_select test_rename_column/test.py::test_rename_parallel test_rename_column/test.py::test_rename_parallel_same_node test_rename_column/test.py::test_rename_with_parallel_insert test_rename_column/test.py::test_rename_with_parallel_merges test_rename_column/test.py::test_rename_with_parallel_select test_rename_column/test.py::test_rename_with_parallel_slow_insert test_rename_column/test.py::test_rename_with_parallel_ttl_delete test_rename_column/test.py::test_rename_with_parallel_ttl_move test_replicated_merge_tree_s3/test.py::test_drop_cache_on_cluster 'test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[0-16]' 'test_replicated_merge_tree_s3/test.py::test_insert_select_replicated[8192-12]' test_replicated_parse_zk_metadata/test.py::test_replicated_engine_parse_metadata_on_attach test_replicated_table_attach/test.py::test_startup_with_small_bg_pool test_replicated_table_attach/test.py::test_startup_with_small_bg_pool_partitioned test_replicating_constants/test.py::test_different_versions test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_restart_with_unavailable_azure/test.py::test_cluster_alive_after_restart test_restore_external_engines/test.py::test_restore_table test_restore_external_engines/test.py::test_restore_table_null test_rocksdb_read_only/test.py::test_dirctory_missing_after_stop test_rocksdb_read_only/test.py::test_read_only test_role/test.py::test_admin_option test_role/test.py::test_changing_default_roles_affects_new_sessions_only test_role/test.py::test_combine_privileges test_role/test.py::test_create_role test_role/test.py::test_function_current_roles test_role/test.py::test_grant_role_to_role test_role/test.py::test_introspection test_role/test.py::test_revoke_requires_admin_option 'test_role/test.py::test_role_expiration[False]' 'test_role/test.py::test_role_expiration[True]' test_role/test.py::test_roles_cache test_role/test.py::test_set_role test_s3_low_cardinality_right_border/test.py::test_s3_right_border test_s3_low_cardinality_right_border/test.py::test_s3_right_border_2 test_s3_low_cardinality_right_border/test.py::test_s3_right_border_3 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3]' 'test_s3_storage_conf_proxy/test.py::test_s3_with_proxy_list[s3_with_resolver]' test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_no_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_select_access_rights/test_main.py::test_alias test_select_access_rights/test_main.py::test_alias_columns test_select_access_rights/test_main.py::test_materialized_columns test_select_access_rights/test_main.py::test_select_all_columns test_select_access_rights/test_main.py::test_select_all_columns_with_table_grant test_select_access_rights/test_main.py::test_select_count test_select_access_rights/test_main.py::test_select_join test_select_access_rights/test_main.py::test_select_prewhere test_select_access_rights/test_main.py::test_select_single_column test_select_access_rights/test_main.py::test_select_single_column_with_table_grant test_select_access_rights/test_main.py::test_select_union test_select_access_rights/test_main.py::test_select_where test_select_access_rights/test_main.py::test_select_with_row_policy test_shutdown_static_destructor_failure/test.py::test_shutdown test_ssh/test.py::test_create_table test_ssh/test.py::test_no_inserts_from_infile test_ssh/test.py::test_no_queries_from_file test_ssh/test.py::test_no_selects_into_outfile -vvv " altinityinfra/integration-tests-runner:ad96270260ff ' returned non-zero exit status 1.